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FOREWORD 


The  Selection  and  Classification  Technical  Area  (SCTA)  of  the  Army  Re¬ 
search  Institute  (ARI)  currently  is  involved  in  developing  and  validating  new 
paper-and-pencil  and  computerized  instruments  that  measure  cognitive,  percep¬ 
tual,  and  psychomotor  abilities.  This  effort  is  part  of  research  to  improve 
the  selection,  classification,  and  utilization  of  enlisted  personnel — Project  A 

Recognizing  its  potential  merit,  the  Commanding  General  of  the  U.S.  Army 
Armor  School  requested  in  July  1985  that  SCTA  and  the  Fort  Knox  Field  Unit 
undertake  a  joint  effort  to  examine  the  predictive  validity  of  this  test  bat¬ 
tery  for  gunnery  performance  in  newly  commissioned  Armor  Officers,  as  measured 
by  the  Unit  Conduct  of  Fire  Trainer  (UCOFT),  a  high-fidelity  simulator.  Both 
predictor  and  criterion  tests  are  the  result  of  technological  advances  that 
make  readily  accessible  information  heretofore  difficult  to  obtain.  This  ef¬ 
fort  contributes  to  the  SCTA  mission  to  link  soldier  selection  to  job  perfor¬ 
mance  by  using  state-of-the-art  measures.  Findings  were  briefed  to  the  As¬ 
sistant  Commandant  of  the  U.S.  Army  Armor  School  at  Fort  Knox,  Kentucky,  in 
March  1987. 


EDGAR  M.  JOHNSON 
Technical  Director 
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VALIDATION  OF  PSYCHOMOTOR  AND  PERCEPTUAL  PREDICTORS  OF  ARMOR  OFFICER  M-1 
GUNNERY  PERFORMANCE 


EXECUTIVE  SUMMARY 


Requirement : 

To  determine  the  validity  of  the  Project  A  psychoraotor  and  perceptual  com¬ 
puter  and  paper-and-pencil  test  battery  for  predicting  M-1  gunnery  performance 
for  newly  commissioned  Armor  Officers. 

Procedure: 

Ninety-five  students  in  Armor  Officer  Basic  (AOB)  training  courses  who 
were  assigned  to  M-1  training  between  14  January  and  27  August  1986  were  admin¬ 
istered  the  predictor  battery  during  their  first  week  at  AOB.  Half  of  the  bat¬ 
tery  consisted  of  five  paper-and-pencii  tests  of  spatial  visualization  (rota¬ 
tion  and  scanning),  spatial  orientation,  and  figural  reasoning  (induction). 

The  other  half  consisted  of  10  computerized  tests  measuring  simple  and  choice 
reaction  time  (processing  efficiency),  short-term  memory,  psychoraotor  precision 
(two  tests),  perceptual  speed  and  accuracy  (two  t..ots),  two-hand  coordination, 
number  operations,  and  movement  judgment.  These  tests  provided  a  total  of  32 
different  scores.  Data  analyses  were  performed  using  the  scores  individually 
and  combined  into  six  composites.  The  Nelson-Denny  Reading  Test,  a  measure  of 
general  verbal  ability,  taken  as  part  of  regular  course  procedures,  was  in¬ 
cluded  as  an  additional  predictor.  Approximately  2  to  3  weeks  before  comple¬ 
tion  of  the  course,  subjects  were  tested  on  tank  gunnery  performance  on  the 
Unit  Conduct  of  Fire  Trainer  (UCOFT),  a  high-fidelity  simulator.  The  UCOFT 
provided  scores  for  number  of  hits  and  opening  times  over  three  sets  of  exer¬ 
cises  under  different  conditions  and  for  tracking  error  from  a  fourth  exercise. 
A  UCOFT  Composite  Score  combining  all  three  variables  was  used  as  the  major 
criterion  for  analysis. 


Findings : 

The  predictor  battery  e:<hibits  substantial  criterion  validity.  Stepwise 
multiple  regression  of  the  UCOFT  Composite  Score  on  the  individual  predictor 
variables  resulted  in  a  regression  model  containing  seven  variables  from  five 
tests  with  a  multiple  correlation  coefficient  {R)  equal  to  .76.  This  indi¬ 
cates  that  the  regression  model  can  •’'’count  for  mor^  rhan  half  (53%)  of  the 
variance  in  criterion  scores.  Nelson-Jenny  score  did  not  ei.«.ci:  into  the 
equation.  By  itself,  Nelsou-Denny  score,  as  a  measure  of  general  ability,  car 
explain  only  4%  of  the  criterion  variance.  This  variance  is  subsumed  by  that 
explained  by  the  regression  model-  Subsequent  discriminant  analysis  with  the 
reduced  set  of  variables  correctly  classified  94%  of  the  cases  as  successful 
(upper  95%)  or  unsuccessful  (lower  5%),  with  most  errors  found  for  marginal 
cases.  Similarly,  lower,  but  still  ample,  validity  was  fojnd  by  regressing 
(a)  composite  scores  based  on  subsets  of  the  exercises  on  '.he  individual 


predictor  variables  and  (b)  total  Composite  Score  on  six  predictor  composites 
formulated  on  the  basis  of  factor  analysis. 


Utilization  of  Findings: 

The  research  results  demonstrate  that  a  measure  of  general  ability  has 
little  validity  for  predicting  gunnery  performance  as  measured  here,  but  that 
the  battery  of  predictors  taken  from  Project  A  has  a  high  level  of  validity  for 
this  small  sample.  These  findings,  which  require  cross-validation  with  addi¬ 
tional  samples  of  subjects,  can  be  used  by  the  Armor  School  to  develop  an  Armor 
Officer  preaccession  screen  using  these  or  similar  predictor  measures,  and  to 
select  tank  gunners  in  general.  Moreover,  the  results  show  that  prediction 
based  on  general  ability  can  be  incremented  by  using  perceptual  and  psychomotor 
tests  for  certain  kinds  of  performance. 
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VALIDATION  OF  PSYCHOMOTOR  AND  PERCEPTUAL  PREDICTORS 
OF  ARMOR  OFFICER  M-1  GUNNERY  PERFOPMANCE 

INTRODUCTION 


The  issue  of  selection  and  assignment  of  the  best  individuals  to  jobs 
within  the  military  is  an  ongoing  problem.  Researchers  constantly  are 
working  to  improve  methods  available  for  maximizing  person-to-job  matches. 
Although  problems  occur  at  all  levels,  both  for  enlisted  and  officers,  the 
greatest  amount  of  attention  tends  to  focus  on  entry-level  classification. 
At  the  present  time,  the  Army  is  involved  in  an  extensive  research  program 
to  improve  procedures  for  the  selection  and  classification  of  enlisted 
personnel.  Project  A  (Eaton,  Goer,  Harris,  &  Zook,  1984).  One  of  the  ob¬ 
jectives  of  Project  A  is  to  expand  the  range  of  tools  available  to  enable 
measurement  of  cognitive,  perceptual  and  psychoraotor  abilities  and  tem¬ 
perament  variables  within  individuals  and  to  determine  how  these  abilities 
relate  to  success.  Work  in  this  area  has  resulted  in  a  Trial  Battery  of 
both  pencil -and -paper  and  computerized  tests  to  predict  job  performance 
among  enlisted  personnel.  Data  to  validate  the  Trial  Battery  against  a 
number  of  job  performance  criteria  (hands-on  tests,  peer  and  supervisory 
ratings,  and  job  knowledge  tests)  were  collected  during  the  Project  A  Con¬ 
current  Validation  (CV)  and  are  currently  undergoing  analyses.  Prelimi¬ 
nary  analyses  indicate  that  the  Project  A  Trial  Battery  provides 
incremental  validity  over  that  of  ASVAB  alone  (Campbell,  1986)  in  predict¬ 
ing  enlisted  performance. 

Although  the  Trial  Battery  was  created  with  the  general  purpose  of 
selection  and  classification  of  enlisted  personnel,  it  may  have  potential 
for  additional  applications  and  solution  of  other  more  specific  problems. 
Specifically,  the  present  research  reports  on  efforts  to  examine  the  va¬ 
lidity  of  some  of  the  Trial  Battery  as  predictors  of  gunnery  performance 
among  new  Armor  officers.  This  work  was  undertaken  at  the  request  of  the 
Commanding  General  of  the  U.S.  Array  Armor  School  at  Fort  Knox,  Kentucky. 

The  Army  Problem 

Division  86  Tank  Platoons  contain  four  tanks,  one  of  which  is  com¬ 
manded  by  the  platoon  leader  (Pit  Ldr).  The  Pit  Ldr's  battlefield  respon¬ 
sibilities  include  controlling  the  movement  of  the  platoon,  employing  all 
available  fires,  including  the  call  for  indirect  and  the  distribution  of 
platoon  fires,  and  keeping  the  company  commander  informed  of  the  situa¬ 
tion.  Equally  important,  the  Pit  Ldr  must  effectively  fight  his  tank,  as 
his  tank  represents  one-quarter  of  the  platoon  firepov/er.  To  be  success¬ 
ful,  the  Pit  Ldr  must  lead  and  execute  by  example,  using  the  leadership 
concept  of  "follow  me  and  do  as  I  do"  (The  Division  86  Tank  Platoon,  1986^. 

Gaining  the  respect  of  platoon  members  is  by  no  means  automatic,  but  a 
function  of  how  well  the  Pit  Ldr  performs.  Given  the  armor  combat  mission 
to  put  "steel  on  target,"  execution  of  gunnery  skills  is  particularly 
important.  The  acceptance  oi  the  Pit  Ldr  and  ultimately  the  success  of 
the  platoon  on  the  battlefield  is  therefore  determined  by  the  Pit  Ldr's 
ability  to  demonstrate  at  least  minimal  proficiency  in  gunnery,  in  addi¬ 
tion,  gunnery  performance,  particularly  poor  performance,  can  weigh  heav¬ 
ily  in  an  Officer's  Efficiency  Rating  (OER)  and,  hence,  his  career. 


Pit  Ldr  training  is  given  in  the  Armor  Ofticer  Basic  (AOB)  course  to 
second  lieutenants  (2LT)  who  have  just  entered  the  Army  from  the  U.S. 
Military  Academy,  university  Reserve  Officer  Training  Corps  (ROTC)  or  who 
have  been  promoted  from  enlisted  ranks  through  Officer's  Candidate  School 
(OCS).  The  AOB  course  taught  by  the  Armor  School,  Fort  Knox,  KY,  contains 
approximately  4  months  of  training,  less  than  half  of  which  is  actually  on 
tanks  or  dealing  with  gunnery.  By  comparison,  the  two  enlisted  tank  com¬ 
manders  (TC)  in  the  platoon  typically  have  more  than  four  years  of  armor 
experience,  with  the  platoon  sergeant  having  eight  to  ten  years  experi¬ 
ence.  In  practice,  the  new  Pit  Ldr  receives  the  majority  of  his  tank 
training  from  his  platoon  sergeant  and  company  commander  after  taking 
command  of  his  first  platoon. 

The  basic  problem  addressed  by  this  research  concerns  the  small  per¬ 
centage  of  AOB  graduates  who  are  so  uncoordinated  that  they  are  unlikely 
to  become  successful  Pit  Ldrs.  Like  all  otner  tanks  in  the  battalion,  the 
Pit  Ldr  is  expected  to  qualify  his  tank  on  the  tank  table  exercises.  Cer¬ 
tain  novice  Pit  Ldrs  with  limited  psychomotor,  perceptual,  and  spatial 
skills  have  such  poor  gunnery  skills  chat  tank  qualification  is  virtually 
impossible.  Similarly,  certain  Pit  Ldrs  are  so  uncoordinated  that  they 
never  develop  acceptable  gunnery  skills  regardless  of  the  amount  of  train¬ 
ing. 

Deficiency  in  psychomotor,  perceptual,  and  spatial  skills  related  to 
gunnery  performance  may  be  detrimental  to  Pit  Ldr’s  effectiveness  for  two 
reasons.  First,  those  lacking  needed  skills  fail  to  gain  the  respect  of 
their  platoon  because  they  cannot  lead  by  example.  Lack  of  crew  confi¬ 
dence  Chen  spreads  to  other  areas  not  related  to  gunnery,  even  when  the 
Pic  Ldr  is  effective  in  those  areas.  Second,  a  Pit  Ldr  who  cannot  fight 
his  tank  may  cause  battlefield  casualties  for  himself  and  the  entire  pla¬ 
toon.  These  same  officers,  however,  may  well  be  intelligent,  motivated, 
and  have  a  successful  Army  career  in  a  non-combat  arms  branch.  It  would 
be  valuable  for  both  the  Army  and  the  individual  if  a  diagnostic  tool 
could  direct  individuals  early-on  into  career  fields  to  which  they  are 
better  suited. 

One  problem  chat  has  occurred  in  attempts  to  predict  armor  gunnery 
performance  is  selection  of  the  appropriate  criterion.  Ideally,  predictor 
tests  are  validated  against  on-the-job  performance.  For  armor  gunnery, 
the  tendency  has  been  to  use  Tank  Table  VIII  qualification  scores. 
Live-fire  scores,  however,  may  not  always  be  most  appropriate.  Problems 
affecting  the  reliability  of  these  scores,  e.g.,  varying  weather  and 
equipment  conditions,  make  questionable  the  comparison  of  scores  across 
days,  ranges,  and  units.  Tank  table  exercises,  in  addition,  measure  total 
crew  performance.  This  is  inappropriate  if  one  is  interested  in  the  per¬ 
formance  of  an  individual  crewman.  The  use  of  Tank  Table  VIII  as  a  valid 
measure  of  individual  performance  is  also  suspect  in  that  the  primary  goal 
of  Tank  Table  VIII  is  to  qualify  as  many  tanks  as  possible.  Every  effort 
is  therefore  made  by  the  unit  to  minimize  the  effects  of  individual  crew 
deficiencies.  While  some  of  the  live-fire  criterion  problems  can  be 
eliminated  by  running  well -con trolled  gunnery  exercises  specifically  for 
validation  research,  ammunition  costs  and  support  requirements  usually 


prohibit  such  an  effort.  In  addition,  live-fire  exercises  designed  to 
evaluate  gunnery  skills  of  minimally  trained  crewmen  (such  as  in  the  pres¬ 
ent  research)  pose  safety  problems. 

High-fidelity  tank  gunnery  simulators  such  as  the  Unit  Conduct  of  Fire 
Trainer  (UCOFT)  are  being  considered  as  alternatives  to  live-fire  testing 
as  performance  measures.  The  M-1  UCOFT  is  a  whole-task  gunnery  trainer 
which  simulates  the  tank  optics  system  with  computer-generated  imagery. 

The  TC  and  gunner  controls  are  virtually  identical  to  those  in  the  actual 
tank,  making  the  UCOFT  analogous  to  flight  simulators  used  in  military  and 
commercial  training.  The  UCOFT  can  measure  performance  on  a  full  range  of 
target  engagement  tasks:  target  acquisition,  laying  the  gun,  and  the 
issuing  of  fire  commands.  Device-mediated  tests  with  the  UCOFT  offer 
certain  advantages  oyer  other  hands-on  performance  tests.  These  plusses 
include  standardized  administration  and  scoring  and  the  capability  of 
inexpensively  building  longer  tests  with  varied  target  conditions.  An¬ 
other  advantage  of  the  UCOFT  is  that  it  trains  and/or  tests  degraded  mode 
gunnery  techniques.  For  example,  the  computer  can  simulate  failure  of 
various  components  in  the  fire  control  system,  e.g.,  the  laser  range 
finder . 

Another  problem  in  predicting  gunnery  performance  is  determining  the 
best  predictive  measures.  Although  higher  general  ability  people  may 
perform  better  in  Table  VIII  exercises  (Scribner,  Smith,  &  Baldwin,  1986), 
among  new  officers  witn  fairly  equal  ability,  other  measures  are  needed  to 
distinguish  unsuccessful  from  successful  gunners.  In  this  research,  the 
predictors  were  not  developea  specifically  to  predict  gunnery  perform¬ 
ance.  However,  the  psycnomotcr  and  perceptual  abilities  they  are  intended 
to  measure  do  have  face  validity  for  gunnery  performance.  That  is,  one 
can  easily  agree  that  these  types  of  abilities  appear  to  be  necessary  for 
successful  performance. 

METHOD 


Sample 


Subjects  were  2LTs  who  participated  in  the  Armor  Officers  Basic  Train¬ 
ing  (AOB)  courses  in  session  between  14  January  and  27  August  1986  and  wno 
were  assigned  to  M-1  tank  training.  A  total  of  6  classes  were  tested  and 
classes  ranged  from  8  to  24  officers  eacn.  Although  112  subjects  took  the 
predictor  battery,  criterion  data  were  available  for  only  95  of  these. 

This  reduction  in  subjects  was  due  to  such  things  as  failure  to  complete 
the  course,  scheduling  difficulties,  and  loss  of  data  due  to  electrical 
failure.  In  addition,  portions  of  the  criterion  data  unavoidably  were 
lost  on  an  individual  basis  in  the  process  of  data  transfer. 


Description  of  the  Instruments 


Table  1  is  a  summary  of  the  battery  of  instruments  used  in  this  re¬ 
search.  The  names  of  the  scores  obtained  from  each  are  noted.  More  thor¬ 
ough  descriptions  of  the  tests  are  presented  below.  The  Project  A  Trial 
Battery  contained  an  additional  spatial  test,  Assembling  Objects.  This 
test  was  eliminated  from  the  present  research  because  of  time  limitations. 
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Table  1 


Summary  of  Predictor  Measures 


Test 

t^me 

Nonber 

Construct  of  Items 

Time 

Limit 

Score  Reliability 

fbisonHDenny 

feoeral  Verbal 

136 

- 

No.  Correct 

.91^ 

Reading  Test 

Ability 

Ebrt  1:  Vocabulary 

100 

15  min. 

i^rt  2:  ConprehensiOTi 

136 

20  min. 

Project  A  Tfests 

I^per  and  Pencil  Tests 

Reasoning  Test 

Induction 

30 

12  min. 

No.  correct 

CO 

Object  Rotation 

Spatial  Visiali- 

90 

7.5  min. 

No.  correct 

.99 

Test 

zation:  Rotation 

Orientation 

Spatial 

24 

10  min. 

No.  correct 

.89 

Test 

Orientation 

thze  Test 

^tial  Visiali- 

24 

5.5  min. 

No.  correct 

.96 

zation;  Scanning 

tep  Test 

Spatial 

20 

12  min. 

No.  correct 

.90 

Orientation 

Conputerized  Tests 

Simple  Reaction 

Processing 

15 

— 

Decision  time  mean 

.88 

Time 

Efficiency 

Movement  time  mean 

— 

%  correct 

.46 

Ctoioe  Reaction 

Processing 

30 

— 

Decision  time  mean 

.97 

Tims 

Efficiency 

Movement  time  nean 

— 

X  correct 

.57 

Memory  Test 

Short  Term  Memory 

36 

— 

Decision  time  mean 

.96 

Movement  time  mean 

— 

%  correct 

.60 

Target  Tracking  1 

Psychcmotor 

18 

— 

Mean  log 

.96 

Precision 

(distance  +  1) 

Perceptual  Speed 

PercepOHl  speed 

36 

— 

Decision  tiras  mean 

.94 

and  Accuracy 

and  accuracy 

Movement  time  nean 

— 

%  correct 

.65 

larger  Tracking  2 

TVra-hand 

18 

— 

Mean  log 

.96 

coordination 

(distance  +  1) 

Construct 


of  Items  Limit 


Reliability 


limber  Memory 

Nunber  Operations 

28 

— 

Final  response 

.88 

lest 

time  mean 

Input  response 
time  mean 

Pooled  operation 

.95 

nean 

.93' 

%  correct 

.59 

Cannon  Shoot 

I'tovemant  judgjnent 

36 

Absolute  tiros 
discrepancy  ffean 
Mean  log 
(distance  -f  1) 

.65 

error 

- 

%  nits 

- 

Target 

Eferceptial  speed 

36 

— 

Decision  tine  mean 

.97 

Identification 

and  accuracy 

Movement  mean 

- 

7.  correct 

.62 

Target  Shoot 

Psychoffiotor 

30 

— 

Mean  log 

Test 

precision 

(distance  -f  1) 

error 

.74 

ffean  time  to  fire 

.85 

hfedian  alternative  fonts  reliability  obtained  from  test  manual. 

Split-naif  ^odd-even)  reliability  with  Spearman-Brown  Oorrection  for  length  based  on 
P-oject  A  Ooncurrent  \alidation  (CV)  data  (n  =  S332  to  9345). 

Coefficient  alpha  reliability  based  on  CV  data. 


Nelson -Pepny  Reading  Test 

As  a  regular  part  of  the  AOB  course,  students  are  given  the  Nel- 
son-Denny  Reading  Test.  Reading  tests  such  as  the  Nelson-Denny  have  been 
shown  to  correlate  very  highly  with  measures  of  general  ability  or 
trainabili ty .  For  example,  the  Adult  Basic  Literacy  Examination  (ABLE) 
nas  been  found  to  correlate  .85  with  the  General  Technical  (GT)  composite 
obtained  from  the  ASVAB  (F.C.  Grafton,  personal  communication,  January  6, 
1987).  In  this  research,  we  used  total  score  combining  the  Vocabulary  and 
Comprehension  subtests  taken  during  the  AOB  course  as  a  measure  of  general 
abili ty . 

Paper-and -Pencil  Tests 


I 

r^l 

V 
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¥ 

I 
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Reasoning.  This  instrument  measures  figural  reasoning,  or  the  ability 
to  determine  the  underlying  principles  governing  relationships  among  a 
series  of  figures.  Each  item  consists  of  four  figures  in  a  series.  The 
examinee  must  decide  what  pattern  or  rule  governs  their  relationship  and 
select  the  figure  tnat  completes  the  series  from  five  alternatives.  This 
test  is  expected  to  contribute  to  prediction  of  performance  in  such  areas 
as  detecting  and  identifying  targets,  troubleshooting  and  repair  work,  and 
analysis  of  intelligence  data  (Peterson,  1987). 

Object  Rotation.  This  test  measures  spatial  visualization/rotation 
involving  two-dimensional  figures.  This  is  the  ability  mentally  to  rotate 
figures  or  to  manipulate  or  restructure  their  component  parts.  In  this 
test,  examinees  are  presented  with  two  test  objects  (stimulus  figures). 

For  each  object  there  are  five  test  items.  These  items  consist  of  the 
same  figure  as  the  object  only  flipped  over  or  rotated  in  one  direction  or 
anotner.  Tne  examinee  must  indicate  whether  the  item  figure  is  the  “same" 
(rotated)  or  "not  same"  (flipped).  Development  of  the  test  was  based  on 
the  expectation  chat  it  would  predict  success  in  such  areas  as  map  drawing 
and  use  and  mechanical  or  construction  operations  (Peterson,  1987). 

Orientation.  This  test  measures  the  ability  to  maintain  one’s  per¬ 
spective  or  bearing  with  respect  to  some  object  when  it  and  its  component 
parts  have  been  rotated.  In  this  test,  each  item  presents  a  picture 
within  a  frame,  but  the  picture  is  in  a  non-upright  position.  Ac  the  bot¬ 
tom  of  the  frame,  there  is  a  circle  with  a  doc  inside.  The  examinee  men¬ 
tally  must  rotate  the  frame  so  that  it  is  lined  up  correctly  with  the 
picture.  Then,  because  the  dot  within  the  circle  also  rotates,  he/she 
must  decide  the  placement  of  the  dot  (i.e.,  how  the  dot  should  look  in 
relation  to  the  circle).  Five  response  choices  are  provided.  This  test 
is  expected  to  predict  success  in  activities  involving  maintaining  posi¬ 
tion  relative  to  environmental  landmarks  or  location  under  frequent  direc¬ 
tional  changes  (Peterson,  1987). 
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Haze.  This  instrument  measures  a  different  aspect  of  spatial  visuali¬ 
zation,  spatial  scanning.  This  is  the  ability  to  scan  or  survey  a  complex 
field  visually  and  to  identify  a  particular  pattern,  configuration,  or 
pathway  within  the  field.  The  test  items  are  rectangular  mazes  with  four 
labeled  entrances  (A  to  Dj  and  several  exits.  Only  one  entrance  leads  to 


an  exit  and  the  examinee  must  decide  which  one  it  is.  This  test  is  likely 
to  predict  success  in  using  maps  in  the  field,  in  electronic  operations, 
and  in  air  traffic  controlling  (Peterson,  19P/)* 

Map.  This  is  also  a  test  of  spatial  orientation.  It  was  designed  to 
test  the  ability  to  establish  and  maintain  one's  bearing  or  to  reorient 
oneself  in  relation  to  environmental  features  or  landmarks  (Peterson, 
1987).  The  test  consists  or  presentation  of  two  different  maps  with  land¬ 
marks  (e.g.,  mess  hall,  campsite,  lake).  No  indication  of  compass  direc¬ 
tions  are  indicated  on  the  maps.  Ten  test  items  refer  to  each  map.  Each 
item  provides  information  about  direction  (e.g.,  ’’the  forest  is  north  of 
the  campsite").  The  subject  must  use  to  this  information  to  determine 
what  direction  to  travel  to  reach  another  landmark. 

Computer  Tests 


Overall .  The  computer  tests  required  a  response  pedestal  specially 
designed  for  this  test  battery.  The  pedestal  is  pictured  in  Figure  1.  It 
has  two  joystic'xs  to  enable  subjects  to  select  which  hand  they  prefer  to 
use,  horizontal  and  vertical  slide  controls,  three  response  buttons  (BLUE, 
WHITE,  and  YELLOW),  and  two  RED  buttons.  Four  green  "HOME"  buttons  serve 
tne  special  purposes  of  a)  controlling  the  location  or  subjects  hands 
during  stimulus  presentation,  b)  controlling  the  onset  of  test  items,  and 
c)  enabling  assessment  of  both  decision  and  movement  components  of  reac¬ 
tion  time  (Peterson,  1987). 

As  indicated  in  Table  1,  Simple  and  Choice  Reaction  Time,  Memory, 
Perceptual  Speed  and  Accuracy,  and  Target  Identification  yield  decision 
time  means  (time  from  onset  of  stimulus  to  release  of  HOME  button)  and 
movement  time  means  (time  from  release  of  ’riO.ML  to  hitting  response  button) 
and  percent  correct  scores.  The  first  cwo  scores  are  trimmed  of  highest 
and  lowest  responses  because  subtle  events  such  as  guessing  time  of  next 
onset,  stretching,  yawning,  etc.,  can  produce  extreme  scores  (Peterson, 
1986).  .Mean  log  (distance  -r  1)  error  scores  for  Target  Tracking  1  and  2 
and  Target  Shoot  are  based  on  the  distance  from  the  center  or  the 
crosshairs  to  the  center  or  the  target  box.  For  the  tracking  tests,  the 
distance  is  measured  repeatedly  —  approximately  500  times  per  trial.  The 
mean  of  these  distances  xs  uS'' ’  ^-r  tte  per-trial  scores  which,  in  turn, 
are  averaged  to  yield  one  me.  oc«.  For  Target  Shoot  only  one  distance 
measure  is  taken  per  trial  (ac  the  time  of  firing).  Cannon  Shoot  .Absolute 
Time  Discrepancy  Mean  is  tr..-  average  of  the  absolute  value  of  tne  differ¬ 
ence  (discrepancy)  between  .ne  time  the  subject  fires  and  the  optimal 
firing  time  '"or  making  a  direct  hit.  Number  Memory  scores  present  mean 
scores  for  processing  each  step,  i.e..  time  until  button  is  pushed  to  go 
on  to  the  next  step  (Input  Response  Time),  completing  all  arithmetic  op¬ 
erations  (Pooled  Operations  Time),  and  deciding  if  the  answer  given  is 
correct  (Final  Response  Time).^ 
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^Explanations  for  tni.  scores  presented  here  were  provided  fay  J 
(personal  communication,  January  21,  1987). 


Response  pedestal  for  computerized  tests. 


Simple  Reaction  Time.  The  iirst  test  is  a  measure  of  processing  effi¬ 
ciency.  The  first  five  items  are  practice  items  to  enable  the  subject  to 
get  accustomed  to  the  equipment  and  are  not  scored.  Subjects  start  with 
both  hands  on  the  four  HOME  buttons  (ready  position).  Each  item  consists 
of  presentation  of  the  stimulus  word  "YELLOW".  As  soon  as  the  subject 
perceives  the  word,  he  must  press  the  YELLOW  response  button. 

Choice  Reaction  Time.  The  second  measure  of  processing  efficiency  re¬ 
quires  a  choice  response.  Instead  of  the  stimulus  "YELLOW",  the  stimulus 
is  either  "BLUL"  (7  items)  or  "WHITE"  (8  items).  When  it  appears,  the 
subject  must  release  the  HO.ME  button  and  press  the  correct  color  button. 
All  items  are  scored. 

Memory.  This  tests  measures  "the  rate  at  which  one  observes, 
searches,  anc  recalls  information  contained  in  short-term  memory 
(Peterson,  iS8&,  p.  5-17)".  Subject  begins  with  hands  in  ready  position. 
The  item  stimuli  consist  of  1  to  5  letters  which  are  displayed  for  .5  or  1 
second.  After  2.5  cr  3  seconds  delay,  a  probe  item  (letter)  appears. 
Subject  must  decide  if  the  probe  appeared  in  the  original  stimulus  sec  and 
press  the  WHITE  (yes)  or  BLUE  (no)  button. 

Target  Tracking  1.  This  test  measures  control  precision  or  "ability 
to  make  fine,  highly  controlled  movements  to  adjust  a  machine  control 
mechanise  in  response  to  stimulus  whose  speed  and  direction  of  movement 
are  perfectly  predictable  (Peterson,  1587,  p.  5-35)."  This  pursuit  crack¬ 
ing  task  uses  a  joystick.  For  each  item,  a  path  of  horiaontal  and  verti¬ 
cal  line  segner  «  is  presented.  There  is  a  tar.et  box  with  centered 
crosshairs  at  t.ie  start  of  the  path.  This  target  moves  along  the  path  at 
a  constant  speed.  The  subject  is  required  to  keep  the  crosshairs  centered 
on  target  at  ail  times.  Across  trialt  there  is  variation  in  crosshairs 
and  target  speeds,  length  of  the  path,  number  of  segments  making  up  the 
pa  ch. 

Perceptual  Speed  &  Accuracy.  This  test  measures  ability  to  >.  .  ’e 
simultaneously  presented  stimuli  rapidly.  The  pairs  of  item  stimuli  con¬ 
sist  of  2,  5  or  S  characters  presented  as  a  series  of  letters,  numbers, 
symbols,  or  real  words.  The  subject  must  make  a  determination  of  "same" 
(WHITE  button)  or  "different"  (BLUE  button),  release  the  HOME  button,  and 
press  the  correct  color  button.  Items  disappear  from  the  screen  as  soon 
as  HOME  buttons  are  released  to  prevent  overlap  of  decision  time  with 
movement  time  (Peterson,  1SS7). 

Tai.get  Tracking  2.  This  is  another  pursuit  cracking  test,  but  it  is 
designed  to  measure  muitilimb  (two-handed)  coordination.  Instead  of  a 
joystick,  the  subject  controls  movement  of  the  crosshairs  using  the  verti¬ 
cal  and  horizontal  slides. 

Number  Memory.  This  tests  the  ability  to  do  simple  arithmetic  opera¬ 
tions  quickly  and  accurately  using  one's  memory.  For  each  item,  several 
steps  are  presented.  The  subject  is  first  given  a  number.  This  disap¬ 
pears  when  he  presses  a  button  to  receive  the  next  part  of  the  problem 
which  is  another  number  with  an  operation  sign  (e.g.,  +,  -) .  He  continues 
this  procedure  until  an  answer  is  presented.  Then  the  subject  must  indi- 


cate  if  the  solution  is  correct  (WHITE)  or  not  (BLUE)  and  press  tne  right 
button.  Items  vary  in  the  number  of  parts  or  steps  involved  and  in  the 
time  delay  between  offset-onset  of  each  part. 

Cannon  Shoot.  This  test  measures  movement  judgment,  or  the  ability  to 
determine  when  to  firt  at  a  moving  target  sc  that  the  target  is  hit  when 
it  crosses  the  cannon's  line  of  fire.  Each  trial  begins  with  presentation 
of  a  cannon  followed  shortly  by  appearance  of  a  target  moving  at  constant 
speed  and  direction.  The  subject  must  push  a  RED  response  button  so  that 
the  lines  of  the  shell  and  target  intersect.  Across  trials,  there  is 
variation  in  the  location  of  the  cannon,  speed  and  direction  of  the  tar¬ 
get,  angle  of  target  to  cannon,  distance  from  cannon  to  impact  point  and 
from  fire  point  to  impact  point. 

Target  Identification.  This  is  another  measure  of  perceptual  speed 
and  accuracy  using  meaningful  figurai  representations  rather  than  numbers, 
letters,  symbols,  or  words,  in  this  test,  each  item  consists  of  a  target 
figure  (representing  simple  renditions  of  tanks  and  other  tracked  vehi¬ 
cles,  helicopters,  fixed-wing  aircraft)  at  the  top  of  the  screen  and  three 
stimulus  figures  (labeled  BLUE,  YELLOW,  and  WHITE),  one  of  which  matches 
the  target  object  at  the  bottom  of  the  screen.  The  drawings  used  are 
modeled  on  the  standard  flash  cards  used  in  training  soldiers  to  recognize 
vehicles,  etc.  The  subject  must  identify  the  matching  stimulus  and  press 
the  correct  color  button.  Targets  vary  from  the  stimuli  in  size,  angle  of 
rotation,  and/ot  direction  (face  left  or  right). 

Target  Shoot.  This  measures  psychosotor  precision.  For  each  trial, 
the  ^rget  box  and  crosshairs  appear  at  different  points  on  the  screen. 

The  target  moves  about  unpredictably,  changing  both  speed  and  direction. 
Using  the  joystick,  the  subject  must  center  the  crosshairs  on  the  target 
and  press  a  RED  button  to  "fire"  at  the  target. 

UCOFT  Criterion  Test 

A  UCOFT  test  was  designed  to  assess  gunnery  skills  necessary  for  en¬ 
gaging  targets  with  the  main  gun  from  the  TC’s  station  and  piloted  with 
several  subjects.  During  a  target  engagement,  the  TC  must  identify  the 
target  and  make  a  gross  lay  of  the  main  gun  such  that  the  target  is  within 
the  3  power  field  of  the  view  of  the  gunner's  primary  sight.  In  an  at¬ 
tempt  to  measure  these  skills,  an  exercise  requiring  the  gross  lay  of  the 
main  gun  was  included  in  the  pilot  UCOFT  test.  This  exercise  required  the 
TC  to  scan  the  simulated  battlefield  through  the  UCOFT' s  forward  unity 
periscope,  and  lay  the  main  gun  near  the  target.  Pilot  subjects  with 
minimal  UCOFT  experience  had  so  much  difficulty  detecting  the  targets, 
however,  that  the  exercise  was  removed  from  the  final  test.  In  addition, 
while  target  acquisition  is  a  critical  aspect  of  gunnery,  acquisition  of 
computer -gene rated  targets  on  the  UCOFT  may  be  unrelated  to  performance  in 
the  field  (Rapkoch  &  Robinson,  1986). 

The  test  shown  in  Table  2  included  a  practice  exercise,  a  tracking  ex¬ 
ercise,  and  three  gunnery  exercises.  The  UCOFT  commander  training  exer¬ 
cises  selected  for  the  test  were  approved  by  the  Weapons  Systems 
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Table  2 


UCOFT  Test  Engagement  Conditions 


Scercise 

Number  or 

Own 

Ocincrol 

Number 

Engagements 

Vehicle 

Ihrget 

ffelfuncdcn 

Practice 

213110 

5 

Stationary 

Short-Range/ 

Moving 

None 

Not 

Scored 

Tiac’jdng 

111561 

5 

Stacionar>- 

Short-Range/ 

Moving 

None 

Target 
Tracked 
for  30 
seconds 

Exercise  A 

223120 

10 

Stationary 

Lcng-Rar:ge/ 

Mo’/ing 

None 

Exercise  B 

224110  6 
224111 

10 

Moving 

Long-Range/ 

Stationary 

None 

Exercise  C 

215210 

10 

Stationary 

Short-Range/ 

Moving 

Stabil¬ 

ization 

System 

Manual 

Lead  Must 
Be  Applied 

Deparcsenc,  USAARMC.  Performance  on  similar  UCOFT  tests  designed  tor 
other  research  has  been  found  to  be  reliable  with  test-retesc  reliability 
coefficients  exceeding  .80  (Graham,  1986) 

The  procedures  used  for  testing  differed  in  several  ways  from  standard 
UCOFT  training  procedures.  All  of  the  test  engagements  were  fired  from  a 
3-man  crew  configuration,  i.e.,  there  was  no  gunner.  As  is  normally  the 
case,  the  ins  true tor/Opera cor  (I/O)  functioned  as  loader  and  driver.  All 
engagements  were  also  fired  with  the  main  gun,  with  only  one  sabot  round 
allowed  per  target.  This  stipulation  eliminated  the  need  for  switching 
the  gun  select  and  ammo  select  switches  located  in  the  gunner's  station, 
and  hence  the  need  for  a  gunner.  The  one  round  per  target  limitation  also 
helped  ensure  that  the  TC  was  prepared  for  subsequent  targets.  In  addi¬ 
tion,  reticle  aim  and  timing  data  are  reported  on  the  UCOFT  only  for  the 
last  round  fired.  Limiting  each  target  to  one  round,  therefore  helped 
standardize  performance  data  across  subjects  and  engagements. 

The  test  also  included  procedures  designed  to  minimize  the  effects  of 
target  acquisition,  as  previous  research  (Graham,  1986)  has  found  acquisi¬ 
tion  times  greatly  influence  UCOFT  performance.  The  purpose  of  the  UCOFT 
test  was  not  to  measure  the  ability  to  discriminate  computer -genera  ted 
images.  Variations  in  target  acquisition  times  were  minimized  by  having 
the  I/O  talk  the  TC  onto  a  reference  point  before  each  target  appeared. 


The  reticle  was  positioned  such  chat  the  target,  e.g.,  a  T-72  tank,  always 
emerged  within  the  10  power  field  oi  view  of  the  gunner's  primary  sight 
(GPS)  extension.  Magnification  was  kept  in  iO  power. 

The  first  exercise  for  record  was  a  UCOFT  "Acquisition  and  Manipula¬ 
tion”  exercise  used  to  assess  smooth  tracking  ability.  The  exercise  in¬ 
cluded  five  moving  targets  for  which  the  TC  had  to  lase,  fire,  and  then 
track  the  target  for  approximately  30  seconds.  Tracking  performance  was 
evaluated  using  two  measures.  The  first  measure  was  Percent  Time  on  Tar¬ 
get,  measured  from  when  the  TC  fired  until  tne  target  disappeared.  This 
measure  was  taken  from  the  liCOFT  "Situation  Monitor"  report  printed  at  tne 
end  of  each  exercise.  The  UCOFT  also  measures  azimuth  and  elevation  de¬ 
viations  from  center  mass  of  target  reported  in  mils  every  second.  From 
these  data  a  Root  Mean  Square  error  from  center  mass  (the  hypotenuse)  was 
calculated  using  the  equation;  RMS  =  V'aZ'^  +  EL"^,  where  A2  and  EL  are 
azimuth  and  elevation  deviation  scores.  For  tne  five  targets,  the  RMS 
error  was  computed  for  the  last  15  secs  of  each  track.  Because  the  TCs 

fired  at  different  times,  only  the  last  15  secs  of  each  track  was  tabu¬ 

lated  to  standardize  the  measure  across  targets  and  subjects.  RMS  error 
is  more  similar  to  tracking  measures  in  the  predictor  tests  amd  provides 

better  information  than  Percent  Time  on  Target.  A  high  inverse  correla¬ 

tion  was  expected  between  the  two  UCOFT  tracking  measures.  Thus,  only  RMS 
error  was  used  in  the  analyses. 

Three  whole  task  gunnery  exercises  were  then  presented  with  ten  en¬ 
gagements  each.  As  seen  in  Table  1,  the  first  of  these  exercises  (Exer¬ 
cise  A)  required  the  TC  to  fire  at  single  long  range  moving  targets  from  a 
stationary  tank.  The  defensive  engagements  required  the  TC  to  give  a  fire 
command  including  a  direction  for  the  driver  to  move  out.  During  the 
simulated  tank  movement,  the  TC  had  to  engage  the  tank  stabilization  sys¬ 
tem  by  depressing  the  palm  switches  on  the  control  handles.  As  the  move¬ 
ment  stopped,  the  TC  moved  the  reticle  onto  the  target,  began  tracking, 
lased,  continued  to  track,  and  pulled  the  trigger.  Good  gunnery  perform¬ 
ance  also  required  that  the  TC  evaluate  whether  the  range  returned  was 
accurate  or  not,  and  the  monitoring  of  the  multiple  laser  return, 
malfunction,  and  ready-to-fire  symbols. 

The  next  set  of  engagements  (Exercise  B)  required  the  TC  to  fire  at 
long  range  stationary  targets  from  a  moving  tank.  On  moving  own-tank  en¬ 
gagements,  the  simulated  tank  made  several  turns  as  it  moved  up  and  down 
hills  towards  the  targets  spaced  up  to  a  minute  and  a  half  apart.  Because 
the  tank  would  sometimes  make  a  turn  only  seconds  before  the  target  ap¬ 
peared,  talking  the  TC  onto  the  reference  point  was  more  difficult  than  on 
the  own -tank  stationary  engagements.  To  aid  this  process,  the  TC  were 
instructed  to  release  the  palm  switches  after  engaging  each  target  which 
disengaged  the  stabilization  system  and  ensured  the  gun  tube  remained  over 
the  front  of  the  tank. 

The  last  set  of  engagements  (Exercise  C)  simulated  failure  of  the 
stabilization  system,  Including  the  auto  lead  mechanism.  This  exercise 
required  the  TC  manually  to  lead  the  short  range  moving  targets  as  a  func¬ 
tion  of  target  speed  and  distance. 


The  dependent  measures  gathered  from  the  three  whole-task  exercises 
were  number  of  hits  and  opening  times.  Number  of  hits  was  simply  the 
number  of  targets  killed  out  of  the  ten  presented  for  each  of  the  three 
exercises.  This  measure  was  actually  first  round  hits  as  only  one  round 
was  fired  at  each  target.  Mean  opening  times  were  computed  separately  for 
the  three  exercises  as  well.  Opening  time  measures  the  amount  of  time 
from  when  the  target  appears  to  when  the  first  round  is  fired.  For  en¬ 
gagements  in  which  no  rounds  were  fired,  an  opening  time  of  Ik  seconds  was 
entered,  the  maximum  UCOFT  opening  time.  Although  there  are  certain 
situations  in  battle  where  it  is  advantageous  not  to  fire,  failure  to  fire 
at  UCOFT  targets  is,  however,  by  definition,  an  error.  Assigning  the 
maximum  opening  time  when  the  TC  did  not  fire  gave  a  poor  score  for  poor 
performance . 

We  calculated  a  speed/accuracy  score  for  the  three  exercises  individu¬ 
ally  and  over  all  combined  by  subtracting  the  s tandardized  opening  time 
score  from  the  standardized  hit  score.  We  also  calculated  an  overall 
Composite  Score  combining  the  six  standardized  hits  and  opening  times 
scores  with  the  standardized  RMS  error  score  from  the  tracking  exercise. 
The  Composite  Score  was  our  primary  criterion  measure. 

Procedures 

Two  separate  testing  sessions  were  required  for  administration  of  the 
predictors  and  the  criterion  UCOFT  testing.  Subjects  took  the  predictor 
battery  during  their  first  week  of  training.  Thus  there  were  six  sessions 
of  approximately  3-3  1/2  hours.  UCOFT  testing  was  accomplished  approxi¬ 
mately  2-3  weeks  before  course  completion.  Since  only  3  subjects  could  be 
tested  during  each  session,  there  were  approximately  15-18  one  hour  ses¬ 
sions  . 

Predictor  Battery.  The  researchers  advised  all  subjects  of  the  pur¬ 
poses  of  the  test  and  confidentiality  of  the  results  in  a  single  large 
group.  Then  we  randomly  split  subjects  into  two  groups.  One  group  took 
the  computer  battery  first,  the  other  took  the  pencil-and-paper  tests 
first.  The  order  of  tests  within  groups  was  standardized  across  subjects 
and  was  as  indicated  in  Table  1.  All  pencil-and-paper  tests  were  timed. 
Subjects  read  the  instructions  and  were  given  the  opportunity  to  ask  ques¬ 
tions.  The  computerized  tests  were  self-administered  on  Seequa  Chameleon 
computers  using  the  special  response  pedestal.  All  instructions  were 
provided  on  the  computer.  A  researcher  monitored  testing  and  was  availa¬ 
ble  to  answer  questions.  The  Nelson-Denny  Test  was  administered  at  the 
Armor  School  separately  during  regular  course  time. 

Criterion  Testing.  The  UCOFT  test  required  each  soldier  to  be  tested 
individually  for  one  hour.  Operation  of  the  UCOFT  and  administration  of 
the  test  were  performed  by  seven  UCOFT  I/O  provided  by  the  Weapons  System 
Department,  USAARMC.  ARl  personnel  helped  monitor  testing.  The  session 
began  with  a  general  briefing  on  the  project's  purpose  and  a  reminder  that 
data  gathered  would  not  become  part  of  the  soldier's  record. 
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The  I/O  explained  the  UCOFT  procedures  during  the  standard  UCOFT  in¬ 
troductory  exercise  (11121)  and  practice  exercise.  In  the  introductory 
exercise,  the  subjects  (hereafter  referred  to  as  the  TC)  were  shown  each 
of  the  UCOFT  graphic  targets  (tank,  truck,  armored  personnel  carrier,  and 
helicopter).  The  TC  were  shown  center  mass  of  each  target,  i.e.,  the 
location  of  a  perfect  shot,  and  were  told  to  range  with  the  laser  range 
finder  (LRF)  and  fire.  No  troop  or  machine  gun  targets  were  included  in 
the  test.  During  the  introduction,  the  I/Os  reminded  the  TCs  of  the  loca¬ 
tions  of  the  GPS  magnification,  gun  select,  fire  control  mode,  and  turret 
power  switches,  as  manipulation  of  these  switches  were  required  during  tne 
exercises. 

The  I/Os  also  told  the  TC  that  he  must  set  the  gun  select  switch  to 
safe  and  the  magnification  to  3  power  at  the  beginning  of  each  exercise. 
After  each  exercise  began,  he  had  to  set-up  for  a  3-man  crew,  i.e.,  switch 
to  main  gun  and  10  power.  He  was  also  told  that  if  the  tank  was  exposed 
too  long  during  .  defensive  engagement,  the  sight  would  go  black  to  simu¬ 
late  being  killed.  At  that  time  he  had  to  reset  the  gun  select  suitcn  to 
main  gun.  If  a  TC  forgot  to  do  this  during  the  exercise,  the  I/O  reminded 
them  before  the  next  target  appeared. 

Following  opening  instructions,  there  was  a  practice  exercise  (half  of 
exercise  213110)  containing  five  short  range  (<1500  meters)  moving  targets 
which  were  fired  at  from  a  defensive  position,  i.e.,  own  tank  stationary. 
For  defensive  engagements,  the  TC  was  cold  chat  his  tank  was  turret-down 
behind  a  berm  and  chat  he  must  command  the  tank  be  moved  to  a  hull -down 
position  before  firing.  During  practice,  if  he  failed  to  give  the  proper 
command  when  the  target  was  identified,  the  TC  was  reminded  that  the 
proper  S-man  crew  main  gun  fire  command  was  "Load  sabot-Driver  move  out-On 
the  way  (when  round  was  fired ) -Driver  move  back."  If  the  TC  failed  to 
give  Che  proper  fire  command  during  the  exercises,  the  I/O  entered  the  in¬ 
formation  by  hitting  the  ID  ERROR  key,  another  deviation  from  standard 
UCOFT  procedures. 

As  indicated  in  the  test  description  section,  I/O  talked  TC  onto  a 
reference  point  before  eacn  target  to  minimize  variations  in  target 
acquisition  times.  For  example,  the  I/O  would  tell  the  TC  to  "Traverse 
left,"  until  he  was  near  the  target  azimuth  location  indicated  on  the 
I/O's  screen.  The  I/O  would  then  say  "Steady  on  -  place  the  reticle  on 
the  upper  left  corner  of  the  house."  For  some  soldiers  tested,  ARl  per¬ 
sonnel  calked  the  TC  onto  the  targets  rather  than  the  I/O. 

The  I/O  were  instructed  to  help  the  TC  only  during  the  introduction 
and  practice  exercise,  as  this  was  a  gunnery  test  and  not  training.  Dur¬ 
ing  the  practice,  however,  the  TC  were  repeatedly  asked  if  they  had  any 
questions.  Preventing  test  administrators  who  normally  serve  as  Army 
trainers  from  providing  help  to  soldiers  is  a  persistent  problem.  ARI 
personnel  monitored  the  I/O  to  keep  the  coaching  to  a  minimum  during  the 
actual  testing. 
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Analyses 


General  descriptive  statistics  (means  and  standard  deviations)  were 
calculated  for  predictor  and  criterion  scores.  We  ran  separate  factor 
analyses  on  the  criterion  and  predictor  scores  for  data  reduction  pur¬ 
poses,  l.e.,  to  assist,  in  making  informed  decisions  about' creating  com¬ 
posite  scores.  We  computed  correlations  between  the  Nelson-^enny  Score 
and  criterion  score  to  compare  the  predictive  validity  of  Nelson-Denny 
alone'  to  that  of  our  full  battery.  Multiple  regression  analyses  were 
performed  on  the  criterion  composite  for  sets  of  (1)  individual  predictor 
variables,  (2)  predictor  composites  based  on  our  factor  analysis,  and  (3) 
predictor  composites  based  on  preliminary  Project  A  factor  analysis  of  the 
CV  data,  in  order  to  determine  the  amount  of  criterion  variance  accounted 
for  by  the  predictor  variables.  Results  of  the  regressions  were  used  to 
select  subsets  of  variables  with  maximal  relationship  to  the  criterion 
which  were  then  entered  into  discriminant  analyses.  For  these  analyses, 
we  divided  subjects  into  successful  (top  95%  of  scores)  and  unsuccessful 
(bottom  5%  of  scores)  groups  based  on  their  UCOFT  Composite  Score.  The 
discriminant  analyses  then  enabled  us  to  determine  how  accurately  member¬ 
ship  in  each  group  could  be  predicted  from  our  predictor  battery  test 
scores.  Additional  regression  analyses  for  Exercises  A  and  C  combined  and 
Exercise  B  alone  were  performed  to  examine  potential  differences  in 
predictive  validity. 


RESULTS 

Means  and  standard  deviations,  along  with  minimum  and  maximum  values, 
for  both  predictor  and  criterion  variables  are  presented  in  Table  3.  Tne 
UCOFT  Composite  Score  combines  standardized  hits,  opening  times,  and 
tracking  scores.  It  was  calculated  on  the  basis  of  a  principle  components 
factor  analysis  with  varlmax  rotation  which  resulted  in  a  one-factor 
solution.  Factor  loadings  are  given  in  Table  4.  Note  that  hits  have 
negative  loadings.  Because  longer  opening  times  and  greater  tracking  " 
error  reflect  lesser  ability,  however,  in  forming  the  composite,  these 
scores  were  negatively  unit-weighted  and  hits  were  positively 
unit-weighted.  Thus,  Composite  Score  equals  the  sum  of  the  hits  minus  the 
sum  of  the  opening  times  minus  tracking  RMS  error.  When  scores  were 
rounded  to  the  nearest  whole  number,  they  formed  a  nearly  normal  distribu¬ 
tion  . 

We  first  performed  stepwise  regression  analysis  of  the  Composite  Score 
on  the  individual  predictor  variables.  All  Independent  variables  were 
standardized  to  a  mean  of  50  and  a  standard  deviation  of  10.  In  order  to 
incliTde  as  many  subjects  as  possible,  missing  values  were  replaced  with 
the  sample  means.  The  results  of  the  regression  are  summarized  in  Table 
5.  After  nine  steps,  seven  variables  from  five  predictor  tests  met  the 
requirement  that  their  partial  £  be  significant  at  £  <  .05  to  remain  in 
the  equation.  The  multiple  correlation  (R)  equals  .76,  indicating  that 
this  regression  model  can  account  for  58%~of  the  variance  in  Composite 
Score.  The  strunken  or  adjusted  £  was  estimated  to  be  .74,  because  the 
variables  were  standardized,  they  can  be  ranked  according  to  the  absolute 
values  of  the  £  coefficients.  Thus,  Number  Memory  Input  Response  Time 
Mean  has  the  greatest 
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TABLE  3 

Means,  Standard  Deviations,  hinimum  and  Maximum  Values  for  Predictor  and 
Criterion  Sc-'  s. 


Variable. 

N 

Mean^ 

Sd 

Minimum 

Maximum 

Predictors 

Simple  Reaction  Time 

Percent  Correct 

95 

99.1 

4.4 

70.0 

100.0 

Mean  Decision  Time 

94 

27.  9 

4.2 

21.0 

41.3 

Mean  Movement  Time 

94 

21.1 

39.1 

13.4 

35.3 

Choice  Reaction  Time 

Percent  Correct 

95 

99.1 

2.4 

83.3 

100.0 

Decision  Time  Mean 

95 

38.7 

5.3 

26.2 

54.5 

Movement  Time  Mean 

95 

22.3 

3.6 

13.0 

32.5 

Short  Term  Memory 

Percent  Correct 

95 

91.0 

6.8 

66.7 

100.0 

Decision  Time  Mean 

95 

77.5 

19.4 

40.8 

140.3 

Movement  Time  Mean 

95 

35.2 

12.2 

18.7 

87. 5 

Tracking  1 

Mean  Log  (Disc  +  1)  Error 

95 

2.8 

0.4 

2.2 

4.0 

Perceptual  Speed  and  Accuracy 

Percent  Correct 

95 

90.4 

8.0 

55.6 

100.0 

Decision  Time  Mean 

95 

226.2 

54.2 

41.6 

338.5 

Movement  Time  Mean 

95 

31.1 

7.2 

19.3 

60.5 

Tracking  2 

Mean  Log  (Disc  +  1)  Error 

95 

3.5 

0.4 

2.5 

5.0 

Number  Memory 

Percent  Correct 

95 

92.4 

7.3 

67.  9 

100.0 

Final  Response  Time  Mean 

95 

129.0 

28. S 

80.1 

224.2 

Pooled  Operations  Time  Mean 

91 

160.8 

53.1 

63.5 

317.4 

Input  Response  lime  Mean 

95 

126.4 

41.4 

57.2 

287.5 

Cannon  Shoot 

Percent  Hits 

95 

57.1 

8.1 

33.3 

83.0 

Absolute  Time  Discrepancy  Mean 

95 

40.8 

5.8 

23.8 

53.0 

Mean  Log  (,Dist  +  1)  error 

95 

1.5 

0.1 

1.5 

2.0 

Target  Identification 

Percent  Correct 

95 

92.0 

8.  9 

25.0 

100.0 

Decision  Time  Mean 

94 

169.8 

53.5 

50.  9 

486. 5 

Movement  Time  Mean 

94 

33.8 

8.2 

19.8 

67.2 

Target  Shoot 

Percent  Hits 

95 

57.2 

12.2 

23.3 

83.0 

Mean  Time  to  Fire 

95 

245.3 

53.4 

152.7 

394.3 

Mean  Log  (Dist  +  1)  Error 

95 

2.1 

0.2 

1.6 

3.0 

Reasoning  No.  Correct 

95 

23.3 

4.4 

8.0 

30.0 

Obiect  Rotation  No.  Correct 

95 

66.0 

18.5 

16.0 

90.0 

Orientation  No.  Correct 

95 

15.7 

6.6 

0.0 

24.0 

Maze  No.  Correct 

95 

17.  9 

6.0 

6.0 

60.0 

Map  No.  Correct 

95 

13.5 

4.  9 

0.0 

20.0 

Nelson  Denny  Score 

94 

135.0 

24.1 

73.0 

169.0 

Cri teria 

Hit  Rate — Execise  A 

95 

3.7 

1.9 

0.0 

8.0 

Hit  Rate — Execise  B 

95 

6.8 

1.7 

2.0 

10.0 

Hit  Rate — Execise  C 

95 

5.5 

2.0 

1.0 

10.0 

Opening  Time — Exercise  A 

94 

16.1 

2.7 

10.0 

23.0 

Opening  Time — Exercise  B 

94 

11.7 

2.8 

5.1 

19.0 

Opening  Time — Exercise  C 

92 

16.2 

2.6 

10.0 

22.0 

Tracking  Root  Mean  Square  Error 

90 

1.3 

0.5 

0.6 

4.0 

UCOFT  Composite  Score 

95 

-50.0 

43.5 

-183.0 

41.0 

Times  are  in  hundred tns  of  seconds 
bTiroes  are  in  seconds 


Table  4 


Factor  Loadings  for  UCOFT  Scores  from  Principal  Components  Analysis 
with  Varimax  Rotation. 


Dependent  Variables 

Factor  1 

Hi  ts 

Exercise  A“ 

-.  50 

Exercise  B 

-.35 

Exercise  C 

-.60 

Opening  Times 

Exercise  A 

.66 

Exercise  B 

.57 

Exercise  C 

.72 

Tracking  Root  Mean  Square  Error 

.53 

^  Exercise  A  =  Own  stationary  tank,  moving  target 
B  =  Own  tank  moving,  stationary  target 
C  =  Own  tank  degraded  and  stationary,  moving  target 


Table  5 


Results  of  Stepwise  Multiple  Regression  of  UCOFT  Composite  Score  on  the 
Individual  Predictor  Variables 


Variables  in  Equation^ 

B 

Choice  Reaction  Time:  Movement  Time  Mean 

-1.36 

17.24 

Tracking  1 

-1.49 

19.84 

Number  Memory:  pooled 

operations  time  mean 

1.27 

10.20 

Number  Memory:  final 

response  time  mean 

-1.02 

7.03 

Target  Identification,  movement  time  mean 

1.39 

15.97 

Orientation  number  correct 

.98 

8.  95 

Number  Memory:  input 

response  time  mean 

-1.56 

18.62 

R 

.76 

r2 

.58 

Adjusted  R^ 

.  55 

Overall  Model  F 

17.26 

^Stepwise  analysis  required  £<.05  to  stay  in  equation 
^All  ^  reported  have  £<.01. 


weight,  indicating  the  largest  relative  effect  on  the  criterion,  and  Orien 
tatiou  Number  Correct  has  the  smallest  effect  of  the  included  variables. 
The  other  variables  in  the  model  are  Tracking  1,  Target  Identification 
Movement  Time  Mean,  Choice  Reaction  Time  movement  Time  Mean,  Number  Memory 
Pooled  Operations  Time  Mean,  and  Number  Memory  Final  Response  Time  Mean. 
Note  that  Nelson-Denny  Score,  used  as  a  measure  of  general  ability,  did 
not  enter  into  the  equation.  In  comparison  to  R,  the  correlation  of  Nel¬ 
son-Denny  with  Composite  Score  is  only  approximately  .20.  Thus,  general 
ability  can  explain  only  4%  of  the  criterion  variance  —  variance  which  is 
not  unique  from  that  explained  by  the  regression  model. 

This  reduced  set  of  seven  independent  variables  represents  a  subset  of 
variables  particularly  related  to  UCOFT  Composite  Score.  These  variabJes 
were  then  entered  into  a  discriminant  analysis  to  attempt  to  classify 
subjects  according  to  membersnip  in  successful  (upper  95%)  versus  unsuc¬ 
cessful  (lower  5%)  Composite  Score  performance  groups.  Tne  cutoff  score 
defining  the  two  groups  was  -132.  Table  6  contains  the  classification 
table  obtained  from  the  analysis.  The  three  out  of  five  in  the  unsuccess¬ 
ful  group  who  were  correctly  classified  were  the  tnree  lowest  scoring 
subjects.  Although  this  represents  40%  error,  the  two  incorrectly  as¬ 
signed  subjects  (i.e.,  false  positives)  were  borderline  cases  falling  very 
close  to  the  cutoff  score,  with  nearly  equal  probability  of  assignment  to 
either  group  according  to  the  discriminant  analysis.  False  negatives 
(i.e.,  those  incorrectly  assigned  to  the  unsuccessful  group)  represent  a 
small  percentage  (4.5%)  of  the  successful  group.  In  all,  approximately 
94%  of  the  subjects  were  correctly  classified.  Because  the  unsuccessful 
group  is  extremely  small  (n=5),  we  repeated  the  discriminant  analysis 
after  forming  two  equal  groups  (jn=32)  representing  the  top  and  bottom 
thirds  of  the  distribution.  As  seen  in  Table  7,  80%  of  the  subjects  were 
correctly  classified.  In  this  instance  only  28%  of  the  lower  group  were 
false  positives  while  13%  of  the  upper  group  were  false  negatives 

Table  6 


Classification  Summary  from  Discriminant  Analysis  of  UCOFT  Composite 
Score  Using  Reduced  Set  of  Independent  Variables. 


Actual 


Predicted 


Unsuccessful 


Successful 


Total 


Unsuccessful 


Successful 


Percent  of  Cases  Correctly  Classified  =  94% 
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Given  that  both  Exercises  A  and  C  employed  moving  targets  while  Exer¬ 
cise  P  used  stationary  targets  and  that  gunnery  performance  with  station¬ 
ary  targets  has  been  difficult  to  predict  in  the  past  (e.g.,  Eaton, 
Bessemer,  &  Kristiansen,  1979),  we  also  ran  separate  stepwise  regressions 
of  composites  (including  Tracking  RMS  error)  over  Exercise  A  with  C  and 
for  B  alone.  These  regressions  are  summarized  in  Tables  8  and  9.  The 
multiple  correlation  obtained  for  A  and  C  (R  =  .73;  shrunken  R=.71)  is 
almost  as  large  as  for  all  three  exercises  totaled.  The  model  contains 
six  variables,  including  two  of  the  spatial  tests.  The  results  of  the 
regression  on  Exercise  B  are  less  impressive.  Five  variables  entered  the 
equation  and  the  model  can  account  for  only  34%  of  variance  in  the  crite¬ 
rion.  No  spatial  tests  entered  the  equation.  The  three  regression  models 
(for  all  exercises,  A  with  C  alone,  and  B  alone)  had  three  variables  in 
common:  Choice  Reaction  Time  Movement  Time  Mean,  Tracking  1,  and  Target 
Identification  Movement  Time  Mean. 


Table  7 

Classification  Table  From  Discriminant  Analysis  of  UCOFT  Composite 
Score  for  Lower  and  Upper  Thirds  of  the  Distribution  Using  Reduced 
Set  of  Independent  Variables 


Actual 


Predic  ted 


Lower  Third 


Upper  Third 


Lower  third  23 

Upper  third  4 

Percent  of  Cases  Correctly  Classified  =  80% 


9 

28 


For  reference  only,  results  from  additional  stepwise  regressions  of 
the  individual  criterion  variables  Total  Hits,  Total  Opening  Times,  Speed 
Accuracy  combination,  Tracking  RMS  Error,  and  Speed  Accuracy  by  exercise 
are  presented  in  Tables  A-1  to  A-7  in  the  Appendix.  Multiple  Rs  for  these 
criteria  range  from  .43  to  .73.  Any  interpretation  of  these  fTndings  is 
limited  because  of  intercorrelation  of  the  variables  and  inflated  Type  1 
error.  In  addition,  for  comparison,  zero-order  correlations  of  Nel- 
son^Jenny  Score  with  various  dependent  measures  are  given  in  Table  A-8  in 
the  Appendix.  Table  A-9  presents  zero-order  correlations  of  the  other 
predictor  variables  and  criterion  scores. 

Using  Project  A  CV  dita  analysis  as  a  model,  we  decided  to  form  the 
predictor  variables  into  composites  and  repeat  the  regression  and 
discriminant  analyses  with  Composite  Score  as  the  criterion.  We  ran  a 
principal  components  factor  analysis  with  varimax  rotation  and  compared 


Ih; 


•.V 
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Table  8 


Results  of  Stepwise  Multiple  Regression  of  UCOFT  Composite  Score 
for  Exercises  A  and  C  Combined  on  Individual  Predictor  Variables 


Variables  in  Equation® 

B 

pb 

Choice  Reaction  Time:  movement  time  mean 

-.  93 

11.61 

Tracking  1 

-1.58 

32.87 

Cannon  Shoot:  percent  hits 

-.58 

5.00 

Target  Identification: 

movemen  t  time  mean 

.63 

5.25 

Reasoning:  number  correct 

.87 

9.64 

Map:  number  correct 

.69 

5.85 

R 

.73 

r2 

.53 

Adjusted  R^ 

.50 

Overall  Model  F 

16.59 

^Stepwise  analysis  required  p<.05  to  stay  in  equation. 

^All  F  reported  have  p<.05. 

Table  9 

Results  of  Stepwise  Multiple  Regression  of  bCOFT  Composite 
for  Exercise  B  Only  on  Individual  Predictor  Variables 

Score 

Variables  in  Equation® 

B 

pb 

Choice  Reaction  Time:  percent  correct 

.35 

3.  99 

Choice  Reaction  Time:  movement  time  mean 

-.49 

7.17 

Tracking  1 

-.54 

9.65 

Target  Identification:  movement  time  mean 

.56 

9.72 

Number  Memory:  input  response  time  mean 

-.52 

8.54 

R 

.59 

.34 

? 

Adjusted  R'^ 

.31 

Overall  Model  F 

9.37 

^Stepwise  analysis  required  £<.05  to  stay  in  equation. 
^All  F  reported  have  £<.05. 
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the  factor  structure  obtained  with  this  small  A05  sample  to  that  obtained 
with  the  large  CV  sample  (as  reported  in  Campbell  (1986)).  Both  analyses 
resulted  in  6-factor  solutions,  but  the  factors  were  only  moderately  dif¬ 
ferent.  Table  10  presents  the  factor  loading  matrix  on  whicn  we  based  our 
predictor  composites.  Note  that  the  loadings  were  not  completely  clean; 
double  and  even  triple  loadings  occur  for  several  variables  using  a  cutoff 
loading  of  .35.  Scores  were  unit-weighted  positively  or  negatively 
according  to  the  sign  of  the  loading  and  assigned  to  the  one  factor  on 
which  each  score  loaded  highest.  Table  11  compares  the  makeup  of  our 
composites  to  those  of  Project  A.  The  table  along  with  analyses  discussed 
below  show  that  there  are  no  really  substantial  differences  between  the 
composites  based  on  this  small  sample  of  officers  and  the  presumably  more 
stable  composites  based  on  the  large  CV  enlisted  sample. 
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Stepwise  regression  of  Composite  Score  on  the  predictor  composites  re¬ 
sulted  in  a  multiple  ^  =  .58  (shrunken  R=. 57).  Thus,  only  34%  of  the 
variance  in  the  criterion  can  be  explained  by  the  predictor  composites. 

The  regression  model  includes  only  the  Spatial  Abilities  and  Track- 
ing/Psychoraotor  Abilities  composites,  with  the  former  having  the  greater 
relative  effect  on  Composite  Score.  Table  12  summarizes  these  results. 
Reformulation  of  the  composites  according  to  the  Project  A  CV  configurati¬ 
on  resulted  in  nearly  identical  results,  as  is  seen  in  Table  13.  Discrim¬ 
inant  analysis  with  the  two  AOB  predictor  composites  as  independent  varia¬ 
bles  resulted  in  fewer  false  negatives,  but  twice  as  many  false  positives, 
as  there  are  using  the  individual  predictor  variables.  That  is,  there  is 
better  classification  using  the  individual  variables.  Tne  classification 
table  from  the  analysis  is  given  in  Table  14.  Results  from  the  discriminant 
analysis  using  the  upper  and  lower  thirds  as  criterion  groups  are  presented 
in  Table  15.  Here  there  were  fewer  false  positives  and  more  false  negatives 
than  with  use  of  the  individual  variables. 


Table  12 

Results  of  Stepwise  Multiple  Regression  of  UCOFT  Composite  Score 
on  AOB  Predictor  Composites 


Variables  in  Equation^ 

B 

Spatial  Abilities 

.55 

17. 3S 

Tracking/Psychomotor  Abilities 

-.28 

10.31 

R 

.58 

r2 

.34 

Adjusted  R^ 

.33 

Overall  Model  F 

23 

.40 

^  Stepwise  analysis  required  p^<.05  to  stay  in  equation. 
°A11  F  reported  have  p<.01. 


Table  13 


Results  of  Stepwise  Multiple  Regression  of  UCOFT  Composite  Score 
on  Project  A  CV  Predictor  Composite 


Variables  in  Equation^ 


B 


Spatial  Abilities  .50  19.16 
Psychomotor  Abilities  -.34  7.61 

R  .57 
r2  .33 
Adjusted  R^  .32 
Overall  Model  F  22.17 


a 

b 


Stepwise  analysis  required  £<.05  to  stay  in  equation. 
All  F  reported  have  £<.01. 


Table  14 

Classiiica tion  Summary  from  Discriminant  Analysis  of  UCOFT  Composite 
Score  Using  Spatial  and  Psychomotor  Predictor  Composites 


Actual 

Predicted 

Unsuccessful 

Successful 

Total 

Unsuccessful 

i. 

4 

5 

Successful 

1 

89 

90 

Percent  ot  Cases  Correctly  Classified  =  95% 


Table  15 


! 

I  Classification  Summary  From  Discriminant  Analysis  of  UCOFT  Composite 

<  Score  for  Lower  and  Upper  Thirds  of  the  Distribution  Using  Spatial 

'*  Psychomotor  Predictor  Composites 


Ac tual 

Predicted 

Lower  Third 

Upper  Third 

Lower  third 

25 

7 

Upper  third 

6 

26 

Percent  of  Cases 

Correctly  Classified  =  80% 

DISCUSSION 

In  the  present  research,  there  were  many  variables  of  interest  and 
only  a  small  sample  of  subjects.  This  situation  limited  both  the  analyti¬ 
cal  approach  taken  and  the  interpretation  of  the  findings.  As  it  is, 
because  of  the  exploratory  nature  of  this  research,  more  analyses  were 
performed  that  typically  would  be  acceptable.  Given  the  complexity  of  the 
data,  we  attempted  to  simplify  matters  by  first  creating  and  concentrating 
on  a  straightforward  criterion  composite  that  represented  overall  UCOFT 
performance.  Regression  analyses  using  individual  predictor  scores  (as 
well  as  composites  of  these  scores)  as  independent  variables  indicate  that 
the  test  battery  has  substantial  validity  for  predicting  our  criterion. 

We  looked  at  the  predictors  from  two  perspectives  — as  individual 
variables  and  combined  into  composites  —  to  determine  if  one  approach  had 
more  merit  than  the  other  in  predicting  criterion  performance.  We  found  a 
higher  level  of  validity  was  achieved  using  individual  predictor  scores 
rather  than  composites.  The  regression  model  consisting  of  four 
computerized  tests  and  one  paper-and-pencil  test  from  our  psychoraotor 
perceptual  battery  has  excellent  predictive  validity  (R  =  .73).  The  Num¬ 
ber  Memory  test  contributes  three  variables  to  the  regression  model:  Input 
Response  Time,  Final  Response  Time,  and  Pooled  Operations  Time.  These 
scores,  to  an  extent,  may  represent  some  general  ability  (related  more  to 
quantitative  than  verbal  ability,  however)  and  cognitive  speed.  The  Choice 
Reaction  Time  and  Target  Identification  scores  in  the  model  were  for  move¬ 
ment  time  means,  emphasizing  motor  efficiency.  An  oversimplification  of 
these  results  suggests  that  perhaps  the  better  gunners  think  quick,  act 
fast,  and  remain  steady  on  target.  .Although  interpretation  of  why  these 
particular  variables  have  substantial  effect  on  the  criterion  is  not  that 
simple,  the  fact  remains  that  the  tests  can  be  used  to  predict  criterion 
performance  validly.  In  contrast,  Neison-Denny  score,  as  a  measure  of 
general  ability,  demonstrates  little  predictive  validity  (r=.20)  for  gun- 


nery  performance  as  measured  here,  even  though  Nelson-Denny  Scores  show 
more  variability  than  we  expected  in  this  sample.  That  is,  the  general 
ability  test  does  not  tap  into  the  kinds  of  abilities  needed  for  the  cri¬ 
terion  performance  of  interest  here  but  psychomotor  and  predictor  tests 
do.  Of  course,  it  is  essential  to  emphasize  that  these  results  are  based 
on  a  small  sample  and  are  not  likely  to  hold  on  cross-validation.  None¬ 
theless,  given  the  magnitude  of  multiple  R,  even  with  changes  in  the  model 
(e.g.,  inclusion  of  different  variables)  and  considerable  shrinkage,  in 
cross-validation  we  would  expect  to  obtain  moderate  (or  better)  validity. 

The  results  of  the  regression  analysis  involving  the  predictor  compos¬ 
ites  have  the  advantage  of  somewhat  easier  interpretation:  Spatial  and 
tracking  psychomotor  abilities  significantly  impact  UCOFT  performance. 

The  simplicity  of  this  interpretation  provides  face  validity  as  well  as 
criterion  validity.  On  the  other  hand,  using  predictor  composites  re¬ 
sulted  in  lower  criterion  validity.  Although  the  difference  :n  the  per¬ 
cent  of  variance  accounted  tor  by  the  two  models  is  26%,  the  32%  explained 
by  the  model  based  on  composite  scores  is  still  a  substantial  amount.  In 
addition  to  the  fact  that  there  is  greater  error,  based  on  our  results, 
another  disadvantage  to  using  the  composites  regression  model  for  the 
future  is  the  requirement  or  administration  of  all  five  of  the  pa¬ 
per  -and  -pencil  spatial  tests  and  three  of  the  computerized  tests.  (Note: 
if  CV  composites  were  used,  an  additional  five  computer  tests  would  be 
required).  In  comparison,  provided  chat  the  results  reported  nere  are 
replicated  wicn  ocher  samples,  fewer  tests  are  needed  when  using  the  indi¬ 
vidual  variables  model.  Given  that  these  findings  may  not  be  replicated, 
however,  any  future  research  in  this  area  should  include  all  variables. 

When  the  variables  from  the  two  regression  models  were  entered  into 
discriminant  analyses,  both  provided  fairly  accurate  classifications  of 
subjects,  with  individual  variables  giving  more  accurate  assignment  of 
unsuccessful  subjects  than  do  composites.  Our  categorization  of  subjects 
as  successful  and  unsuccessful  was  arbitrary.  A  five  percent  failure 
cutoff  may  be  too  high.  Our  purpose  for  performing  the  analysis  was  to 
determine  to  what  extent  classification  based  on  some  fairly  reasonable 
criterion  was  possible.  In  this  case,  there  is  a  high  level  of  accuracy 
(9A%),  with  most  errors  due  to  marginal  cases — those  close  to  the  cutoff 
score.  Using  the  top  and  bottom  thirds  for  groups,  there  is  an  80%  accu¬ 
racy  level. 


Exercises  A  and  C  were  similar  in  that  both  used  moving  targets,  even 
though  Exercise  C  involved  the  degraded  mode.  On  the  average,  subjects 
were  more  accurate  on  Exercise  5:  It  is  easier  to  hit  a  stationary  tar¬ 
get.  Performance  on  Exercise  3  composite  score,  however,  is  not  predicted 
as  well  as  that  on  Exercises  A  and  C  combined  using  our  test  battery. 
Spatial  abilities  effect  Exercises  A  and  C,  but  do  not  impact  on  B.  The 
multiple  R  for  Exercise  B  is  substantial  {R  =  .59),  but  some  of  this  is 
due  to  prediction  of  the  Tracking  RMS  component  of  this  score.  If  we  con¬ 
sider  only  hits  and  opening  times  for  Exercise  B,  our  predictors  can  only 
account  for  19%  of  the  variance  in  performance.  The  predictor  battery- 
used  here  does  not  really  tap  into  the  abilities  needed  for  gunnery 
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performance  with  stationary  targets.  Because  average  performance  under 
this  condition  is  better,  however,  it  is  probably  not  as  important  that  we 
be  able  to  predict  it.  The  fact  that  prediction  is  poorer  for  this  type 
of  criterion  also  suggests  that  any  future  validations  with  these  or  any 
other  predictors  carefully  consider  this  before  using  gunnery  performance 
with  stationary  targets  as  the  performance  measure. 

CONCLUSIONS 

The  Chief  of  Armor  has  developed  Armor  officer  assessment  procedures 
which  evaluate  the  professional  development  of  the  Armor  officer  and 
delineate  personnel  management  and  professional  decisions.  The  purpose  of 
the  assessment  is  to  provide  guidance  to  the  Armor  officer,  thereby  better 
enabling  him  to  choose  his  career  pattern.  Included  in  the  assessment 
plan  is  a  proposed  pre-accession  screen  which  would  select  officers  with 
the  physical  and  psychomotor  attributes  necessary  to  operate  and  maintain 
the  highly  technological  equipment  being  developed  in  Armor.  Armor  lias 
proposea  expanding  the  physical  and  visual  requirements  of  accessed  offi¬ 
cers  and  the  development  of  a  haud  eye  coordination  test.  The  present 
effort  was  the  first  step  in  the  cevelopment  of  an  Armor  Officer 
pre -accession  screen. 

Tne  results  of  this  research  are  highly  encouraging.  The  Project  A 
predictor  test  battery  has  excellent  criterion  validity  for  gunnery  per¬ 
formance,  here  measured  by  overall  performance  on  the  GCOFT.  The  results 
have  clearly  demonstrated  that  more  than  general  ability  tests  are  neces¬ 
sary  to  predict  this  criterion.  Further,  the  results  have  shown  that  the 
Project  A  paper-and-pencii  and  computer  tests  of  psychomotor,  perceptual, 
and  spatial  abilities  which  were  administered  appear  to  be  excellent  can¬ 
didates  for  the  Armor  officer  pre-accession  screen.  Given  our  results, 
additional  research  is  needed  to  determine  how  well  these  findings  hold  on 
crossvalidation,  and  to  determine  appropriate  standards  for  UCOFT  perform¬ 
ance  and  cutoff  scores  for  predictor  tests. 
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APPENDIX  A 


Table  A-1 

Results  of  Stepwise  Multiple  Regression  of  UCOFT  Hits  Score  Over  All 
Exercises  on  Individual  Predictor  Variables 


Variables  in  Equation® 

B 

Tracking  2 

-.85 

16.58 

Number  Memory:  Input  response  time  mean 

-.61 

8.71 

R 

.52 

r2 

.27 

Overall  Model  F 

16.96 

®  Stepwise  analysis  required  p<.05  to  stay 
All  F  reported  have  p<.01. 

in  equation. 

Table  A -2 

Results  of  Stepwise  Multiple  Regression  of 

UCOFT  Opening 

Times  Over  All 

Exercises  on  Individual  Predictor  Variables 

Variables  in  Equation® 

B 

Choice  Reaction  Time:  movement  time  mean 

.  66 

9.48 

Tracking  1 

.87 

14.89 

Map:  number  correct 

-.59 

6.87 

R., 

.56 

R^ 

.32 

Overall  Model  F 

1A.19 

^Stepwise  analysis  required  £<.05  to  stay  in  equation, 
^All  £  reported  have  £< 
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Table  A -3 

Results  of  Stepwise  Multiple  Regression  of  UCOFT  Speed/Accuracy  Score 
Over  All  Exercises  on  Individual  Predictor  Variables 


Variables  in  Equation® 

T> 

X/ 

Choice  Reaction  Time:  movement  time  mean 

-1.40 

21.32 

Tracking  1 

-1.53 

26.26 

Target  Identification:  movement  time  mean 

00 

6.73 

Map:  number  correct 

.81 

7.30 

Number  Memory:  input  response  time  mean 

-.86 

8.26 

R 

.73 

R"^ 

.  53 

Overall  Model  F 

20.13 

®Stepwise  analysis  required  p<.05  to  stay  in  equation. 

^All  F  reported  have  p<.01. 

Table  A -4 

Results  of  Stepwise  Multiple  Regression  of  UCOFT  Tracking 

(Root 

Mean 

Square  Error)  on  Individual  Predictor  Variables 

Variables  in  Equation® 

B 

pb 

Cannon  Shoot:  absolute  time  discrepancy  mean 

-.25 

7.59 

Target  Shoot:  mean  log  (distance  +1)  error 

.26 

8.44 

Orientation:  number  correct 

-.39 

19.39 

Perceptual  Speed:  movement  time  mean 

-.31 

12.75 

R 

.56 

R^ 

.32 

Overall  Model  F 

10.41 

^Stepwise  analysis  required  ^<.05  to  stay  in  equation. 
®A11  F  reported  have  p<.0i. 
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Table  A-5 


Results  of  Stepwise  Multiple  Regression  of  UCOFT  Speed/Accuracy  Score 
for  Exercise  A  Only  on  Individual  Predictor  Variables 


Variables  in  Equation® 

B 

Choice  Reaction  Time:  movement  time  mean 

-.36 

10.08 

Tracking  1 

-.  94 

60.28 

Cannon  Shoot;  percent  hits 

-.43 

13.24 

Reasoning:  number  correct 

.39 

11.00 

R 

.73 

r2 

.54 

Overall  Model  F 

26.09 

®Stepwise  analysis  required  p<.05  to  stay 

in  equation. 

^All  F  reported  have  p<.01. 

Table  A -6 

Results  of  Stepwise  Multiple  Regression  of 

UCOFT  Speed/Accuracy 

Score 

for  Exercise  B  Only  on  Individual  Predictor  Variables 

Variables  in  Equation® 

B 

Simple  Reaction  Time:  movement  time  mean 

-.38 

7.15 

Number  Memory:  input  response  time  mean 

-.51 

12.88 

R. 

.43 

R^ 

.19 

Overall  Model  F 

10.47 

^Stepwise  analysis  required  p<.05  to  stay  in  equation. 
^All  F  reported  have  p<.01. 
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Table  A-7 


Results  of  Stepwise  Multiple  Regression  of  UCOFT  Speed/Accuracy  Score 
for  Exercise  C  Only  on  Individual  Predictor  Variables 


Variables  in  Equation^ 

B 

F^ 

Choice  Reaction  Time:  movemenc  time 

mean 

-.42 

9.15 

Tracking  1 

-.  44 

8.75 

Reasoning;  number  correct 

.38 

6.17 

Map:  number  correct 

.34 

4.66 

R 

.60 

R^ 

.36 

Overall  Model  F 

12 

.46 

^Stepwise  analysis  required  p<.05  to 
“All  F  reported  have  pSoi- 

stay  in  equation. 

Table  A -8 

Zero-order  Correlations  Between  Nelson-Denny  Test 

and  UCOFT 

Scores 

Exercises 

Scores 

Overall 

1 

2 

3 

Hi  ts 

.17 

.21*  - 

-.01 

.19 

Opening  Times 

-.19 

-.16 

-.16 

-.18 

Tracking 

Speed/Accuracy 

-.19 

.23* 

.24* 

.09 

•22: 

Total  Composite 

.26'' 

.25* 

.19 

.25 

P<.05 
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Table  A-9 

Zero-order  Correlaciooa  Between  Predictor  Variables  and  UCOFT  Criterion  Scores. 


Predictors 

Crlurla 

Hits 

Opening 

Tlaes 

Speed/ 

Accuracy 

Tracking 
RMS  Error 

CoBposite 

Score 

Sisple  Reaction  Xise 

Percent  Correct 

-.04 

.02 

-.03 

.02 

-.03 

Decision  Tiae  Mean 

.01 

.15 

-.09 

.04 

-.09 

Hovcaent  Tiae  Kean 

-.15 

.30** 

-.28** 

-.02 

-.24* 

Choice  Reaction  Tiae 

Percent  Correct 

.22* 

-.15 

.23* 

-.17 

.24 

Decision  Tiae  Kean 

-.10 

.33** 

-.27** 

.11 

-.  26** 

Hovcaent  Tiae  Kean 

-.26* 

.29** 

-.  34*** 

-.08 

-.28** 

Short  Tera  Meoory 

Percent  Correct 

.04 

-.10 

.09 

-.07 

.09 

Decision  Tine  Mean 

.11 

.07 

.02 

-.07 

.04 

Kovenent  Tiae  Kean 

-.19 

.04 

-.14 

-.07 

-.11 

Tracking  1 

Mean  Log  {Dlst  -f  1)  Error 

.45**** 

-.54**** 

.28** 

-.  55**** 

Perceptual  Speed  and  Accuracy 

Percent  Correct 

.08 

-.11 

.12 

.01 

.10 

Decision  Tiae  Mean 

,02 

.02 

.00 

-.05 

.01 

Hoveaent  Tiae  Mean 

.03 

-.06 

.06 

-.29** 

.12 

Tracking  7 

Mean  Log  (Disc  +1)  Error 

*•  43*^*^ 

.39**** 

-.  52**** 

.26* 

-.51**** 

Kucher  Meeory 

Percent  Correct 

.13 

-.21* 

.21* 

-.03 

.19 

Final  Response  Tice  Mean 

-.12 

.27** 

-.25* 

.00 

-.22* 

Fooled  Operations  Tiae  Mean 

-.04 

.02 

-.04 

.04 

-.04 

Input  Response  Tiae  Mean 

-.37*** 

.31** 

-.42**** 

.24* 

-.43**** 

Cannon  Snoot 

Percent  Correct 

-.05 

-.19 

.09 

.14 

.05 

Absolute  Tiae  Discrepancy  Kean 

-.09 

.10 

-.12 

-.15 

-.07 

Mean  Log  (Disc  -f  1}  Error 

.03 

.15 

-.08 

-.17 

-.03 

Target  Identification 

Percent  Correct 

.14 

-.05 

.11 

-.14 

.13 

Decision  Tice  Mean 

-.23* 

.26* 

-.  30** 

.08 

-.29** 

Hoveaent  Tiae  Mean 

.05 

-.02 

.04 

-.20 

.08 

Target  Shoot 

Percent  Correct 

.19 

-.20 

.24* 

-.28** 

.28** 

Mean  Tiae  To  Fire 

-.12 

.31** 

-.27** 

.16 

-.27** 

Kean  Log  (Dist  +  1)  Error 

-.23* 

.15 

-.23* 

.21 

-.25* 

Reasoning  No.  Correct 

.33*** 

-.27** 

.37*** 

-.  24* 

Object  Routlon  No.  Correct 

.35*** 

-.24* 

.36*** 

-.23* 

.37*** 

Ocleotation  No.  Correct 

.23* 

-.35*** 

.36*** 

-. 34*** 

.39**** 

Maze  No.  Correct 

.26* 

-.17 

.26* 

-.19 

.27** 

Map  No.  Correct 

.30** 

-.35*** 

.40**** 

-.28** 

.42**** 

4 

p 

<  .05 

p 

<  .01 

ir*1t 

p 

<  .001 

p 

o 

o 

O 

►*> 
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